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BACKGROUND OF THE INVENTION 



Field of the Invention 

This invention is related to the field of computer network security and, more 
particularly, to ensuring the separation of different user communities. 

Description of the Related Art 

With the ever expanding use of computer networks throughout society and the 
increasing interconnection of computer networks and users has come an increasing 
importance on maintaining the security of data. It is common for enterprise computer 
networks to have more than one user community, each with its own set of data. For 
example, a bank may have a production community which includes persons who are 
involved in the day to day workings of the bank. In addition, a bank may have a 
development community which includes persons working to develop and test new 
banking computer applications. Further, a bank may have a public web site which allows 
Internet users to obtain information or services related to the bank. Each of these user 
communities requires access to different sets of data which in some cases may be 
mutually exclusive. 

In an enterprise network, some computing resources may be dedicated to users of 
a single community, and others may be shared among users of multiple communities. 
Single Community Nodes (SCNs) are network nodes (e.g., computers, networking 
equipment, etc.) processing information on behalf of users in a single community. Multi- 
Community Nodes (MCNs) are network nodes processing information on behalf of 
individuals in more than one community. Examples of MCNs include servers, routers, 
and administrative workstations. Executing on MCNs are Multi-Community Applications 
(MCAs). MCAs are software performing functions on behalf of users in more than one 
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community. MCAs may ran within the operating system kernel or communications 
protocol software, or may be programs running under the control of the operating system 
in an MCN. 

Generally, an enterprise has in place a network security policy which includes a 
community separation policy stating that the data of a particular community should only 
be accessible by members of that community. Consequently, each user on the computer 
network must be prohibited from: (1) accessing the data of a community of which he is 
not a member, and (2) exposing the data of a community of which he is a member to a 
user outside that community. When resources such as MCNs are shared by users in more 
than one community, the potential for a breach of the community separation policy is 
increased and adequate enforcement of the policy takes on greater importance. Threats to 
the security of computer network data include threats from "external intruders" and 
threats from "malicious insiders". An external intruder is a user in one community who 
attempts to access or modify the data of another community, or disrupt service in another 
community by interfering with the normal and proper operations of the computer 
resources used by the other community. On the other hand, a malicious insider is a user in 
one community who attempts to leak data from his own community to a user in another 
community, by sending data packets to another community, causing data packets from his 
community to be misrouted, making data from his community available to external 
intruders, or otherwise using computer resources to leak or signal information. It should 
be noted that an insider may inadvertently leak information to another community due to 
human error or faulty software logic. This may have the same effect as the malicious 
insider who deliberately causes such leakage. 

One well known method of providing for community separation in multi-commu- 
nity enterprise networks includes segmenting the network by community such that all 
computing resources are dedicated to a community and no resources are shared between 
communities. The network segmentation methods involve replicating servers, routers, 
bridges, hubs, switches, and cables, thereby physically segregating user communities. 
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However, such a replication technique is not only costly, it also provides significant 
operational complexities. For example, one type of server is a network management 
station. If such a station were replicated and each station's access were physically 
restricted to a single community's computing resources, the network administrator for the 
enterprise would be able to monitor and control only the network resources for a single 
community from a single station. However, the role of the network administrator requires 
monitoring and control of the entire network. Hence, the security approach significantly 
complicates the management of the network. 

Another practiced method of providing community separation is to use firewalls 
to control the flow of information between communities. A firewall is a method used to 
control information flow between two or more networks by blocking or permitting flows 
according to a predetermined set of rules based on the source and destination of the data, 
the requested service, and other criteria. Firewalls are frequently used by an enterprise to 
control the access of those on an external network, such as the Internet, to the enterprise's 
inner network. Firewalls may also be used to protect some parts of an inner network from 
other parts of an inner network. However, the rules associated with firewalls can be 
complex and onerous to set up. It is also difficult to validate that the rule set enforces 
community separation, and such validation must be done each time the rules are 
modified. 

A third method of providing community separation involves incorporating support 
in applications on the network for cryptographic protocols and data security methods. 
However, such an approach is undesirable as it can be very costly in application develop- 
ment and can be operationally burdensome to administer. 

To further provide for data security, it is common for the network topology and 
node connectivity to be controlled. Such controls may include physical separation, logical 
separation (such as in Virtual Local Area Networks [VLANs]), special privileges or 
authorizations, or cryptographic methods (such as Virtual Private Networks [VPNs]). 
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Such methods typically provide that each network node is physically or logically 
connected to a network (including a network segment, subnetwork, VLAN, network zone, 
network partition, network tunnel, or VPN) only if the node is authorized to access the 
community data being communicated over the network. 

In addition, Multi-Community Applications may be designed so that they may be 
"trusted", i.e., do not violate the community separation policy. In particular, when an 
MCA sends information to a user on another network node, it is trusted not to disclose 
information belonging to communities of which that user and his computer are not mem- 
bers. Some MCNs are "closed" nodes on which only trusted MCAs are allowed to run 
and which do not allow unrestricted user access. However, even if the MCAs are trusted, 
the networking protocols within the MCN could allow community information to be dis- 
closed in violation of the community separation policy, especially if they do not contain 
mechanisms which explicitly provide for community separation enforcement. 

SUMMARY OF THE INVENTION 

One or more of the problems outlined above are in large part solved by the 
methods and mechanisms described herein. Broadly speaking, a method and mechanism 
of community separation control in a multi-community node are contemplated. Generally, 
the method and mechanism include determining a packet community set (PCS) of a first 
data packet, discarding the data packet if the PCS is null or alternately if the PCS is not a 
subset of the intersection of a source network address community set (NACS) and a 
destination NACS of the data packet, and allowing further processing of the data packet if 
the PCS is not null. The PCS of the data packet may be determined by one of the 
following alternative: calculating an intersection of a source network service community 
set (NSCS) and a destination NSCS of the data packet; calculating an intersection of a 
source network address community set (NACS) of the data packet, a destination NACS of 
the data packet, and an application community set (ACS) of the process which sent the 
data packet; or decoding the PCS from the header of the data packet. The method and 
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mechanism may include consulting a community information base which maintains 
community set associations. 

In one embodiment, if the data packet is outgoing, the method and mechanism 
may include discarding the data packet if the PCS is not a subset of an ACS of the 
process which sent the data packet, and discarding the data packet if the PCS is not a 
subset of an interface community set (IFCS) of the interface over which the data packet is 
to be output. Otherwise, further processing may be permitted. If the data packet is 
incoming, the data packet is discarded if the PCS is not a subset of an IFCS over which 
the data packet was received. If the data packet is incoming and its destination is the local 
host, the data packet is discarded if the PCS is not a subset of an ACS of the destination 
process of the data packet. If the data packet is incoming and its destination is a remote 
host, the data packet is discarded if the PCS is not a subset of the IFCS of the output 
interface corresponding to the remote host. Other embodiments may include encodeding 
the PCS in the data packet prior to transmitting the data packet to a remote node. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects and advantages of the invention will become apparent upon reading 
the following detailed description and upon reference to the accompanying drawings in 
which: 

Figure 1 is a diagram of one embodiment of a closed MCN in a multi-community 
network. 

Figure 2 is a diagram illustrating a community route filter send rule in a closed 
MCN. 

Figure 3 is a diagram illustrating the community route filter receive rule in a 
closed MCN. 
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Figure 4a is a flowchart illustrating one embodiment of a community route filter. 
Figure 4b is a flowchart illustrating one embodiment of a community route filter. 
Figure 5 is an illustration of an examplary community information base. 
Figure 6 illustrates the application of a community route filtering rule. 
Figure 7 illustrates the application of a community route filtering rule. 
Figure 8 is a diagram of an MCN using virtual private networks. 
Figure 9a is a flowchart illustrating one embodiment of a community route filter. 
Figure 9b is a flowchart illustrating one embodiment of a community route filter. 

While the invention is susceptible to various modifications and alternative forms, 
specific embodiments thereof are shown by way of example in the drawings and will 
herein be described in detail. It should be understood, however, that the drawings and 
detailed description thereto are not intended to limit the invention to the particular form 
disclosed, but to the contrary, the intention is to cover all modifications, equivalents and 
alternatives falling within the spirit and scope of the present invention as defined by the 
appended claims. 

DETAILED DESCRIPTION OF THE INVENTION 

Overview 

Generally speaking, the methods and mechanisms described herein: 
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• Prevent communications from a network used by one community or communities to a 
network used by different communities; 

• Ensure that packets sent by the MCN are output on an interface attached to a network 
for the intended community; and 

• Detect when remote nodes communicating with the MCN spoof their source network 
address to masquerade as a node in another community. 

Among the embodiments described herein are the following: 

1 . A Community Route Filter (CRF) in the protocol stack of the MCN applies rules on 
each incoming or outgoing packet. The packet's source and destination network 
address are used to determine the user community or set of communities to which a 
packet belongs. The CRF ensures that packet can never flow to networks outside the 
packet's communities. 

2. As in Approach 1, a CRF in the protocol stack of the MCN applies rules on each 
incoming or outgoing packet. The CRF prevents a packet from flowing to networks 
outside the packet's communities. The enforcement has the same effect as with 
Approach 1, but the database is organized differently and rules are expressed 
differently. 

3. The community separation policy is enforced by ensuring that all routing table entries 
comply with the policy. This, combined with restrictions on packet forwarding 
between interfaces and other per packet validations, ensures that a packet cannot flow 
to networks outside the packet's communities. 

The methods and mechanisms described herein use a database of associations of 
sets of communities corresponding to each network addresses of the MCN and each node 
with which it communicates, and of the set of communities associated with each network 
attached to the MCN. The database information and organization may differ for the 
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alternative approaches described herein. In general, the database information is entered 
into the MCN by a trusted administrator. 

Communit y Separation Control in Closed Multi-Community Nodes 

Turning now to Figure 1, a diagram illustrating one embodiment of a computer 
network 100 is shown. Included in computer network 100 is MCN 1 10, a node serving a 
set of user communities including communities A, B, and any other communities in 
network 100. Also on network 100 is another MCN, 144, serving the same communities 
as MCN 110, and two single community nodes: a community A node 140, and a 
community B node 142. 

Community network 100 contains three subnetworks. Network 130, used for com- 
munity A communications, Network 132, used for community B communications, and 
network 134, used for communications between MCN 1 10 and MCN 144 which could 
potentially contain data for any community. 

MCN 110 includes interfaces ifO 150, ifl 152, and if2 154. MCN 110 also 
includes a Multi-Community Application Process (MCA) 120, which is assumed to be 
trusted not to leak data between communities, and Community Information Base (CIB) 
160. Community A network 130 is coupled to MCN 1 10 via interface ifO 150, community 
B network 132 is coupled to MCN 110 via interface ifl 152, and the all communities 
network 134 is coupled to MCN 110 via interface if2 154. Also included in MCN 1 10 is 
processing unit 180. Processing unit 180 may be a general purpose processor which may 
be configured to execute software or may be special purpose logic which is specifically 
designed for data packet filtering operations and other functions. In Figure 1, community 
A network 130 and community B network 132 represent separate user communities and 
all communities network 134 represents a network accessible by MCNs serving all user 
communities. Figure 1 also shows exemplary addresses associated with MCN 110 
network interfaces and with the network interfaces of other network nodes. Interfaces ifO 



8 



150, ifl 152, and if2 154 have addresses 11.1.1.9, 12.1.1.5, and 13.1.1.5, respectively. 
Hosts 140, 142, and 144 have addresses 11.1.1.3, 12.1.1.4, and 13.1.1.4, respectively. For 
illustrative purposes, Internet Protocol (IP) version 4 addresses are used in the description 
herein. However, IPv6 addresses or addresses of any other network layer or data link 
layer protocol may also be used. In one embodiment, MCN 1 10 includes a number of 
processors and is running a single instance of an operating system. 

Community Route Filtering 

As shown in Figure 1, the network topology is designed keep user communities 
separated. Only MCNs have the capability to violate the community separation policy. 
With this topology, if MCNs enforce community separation, then enforcement is 
network- wide. More precisely, the following topology rule must be enforced when the 
network administrators connect the network nodes to the network and configure the 
network switches and other network components and mechanisms: a node may be 
physically or logically connected to a network only if the community or set of 
communities of the node includes the community set of the network. The term "network" 
as used herein includes a subnetwork, network segment, virtual local area network 
(VLAN), network partition, network zone, virtual private network (VPN), network 
tunnel, or any other suitable configuration. The community set of a network is the set of 
communities for which information may be communicated over the network, not to 
include communities whose information is encrypted in a manner preventing access by 
nodes attached to the network. 

In one embodiment, MCN 110 is a closed node. It is assumed that all application 
software running on MCN 1 10, referred to as Multi-Community Applications (MCAs), 
are trusted to enforce community separation. The MCN 110 is further assumed to not 
allow unrestricted user access. Users are permitted to access information in the MCN 
only if the access is permitted by the MCAs on the MCN 1 10. 
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With these assumptions, what is needed is to ensure that the protocol software in 
the MCN 1 10 provides community separation enforcement and that the MCN policy 
enforcement cannot be compromised by entities outside the MCN. In general, MCN 1 10 
either generates packets to send to a variety of destinations, or receives packets from 
other nodes to be processed by the MCA 120 or to be forwarded to a variety of 
destinations. In one embodiment, to ensure that community separation policy is enforced 
for MCN 1 10' s network communications, a Community Route Filter (CRF) in the 
protocol stack of MCN 1 10 applies rules on each incoming or outgoing packet. If an 
incoming or outgoing packet is being routed in compliance with the community 
separation policy, the packet is allowed to pass through the filter. Otherwise, the packet is 
discarded and the event may be recorded in a log of security relevant and other events. 

Generally speaking, functions performed by the CRF in MCN 110 may include, 
but are not limited to, the following: (1) preventing communications from a network used 
by one community or communities to a network used by different communities; (2) 
ensuring that packets sent by the MCN are output on an interface attached to a network 
for the intended community, determined from the communities associated with the source 
and destination network addresses; and (3) detecting when remote nodes communicating 
with the MCN spoof their source network address to masquerade as a node in another 
community. 

In another embodiment, the MCN is configured to control routing table updates so 
that the all entries in the table comply with the community separation policy. In addition, 
a packet forwarding filter may be inserted in the protocol stack for packets being 
forwarded by the MCN from one network interface to another in order to ensure that there 
is a community in common between the incoming and outgoing networks' community 
sets. 

In the descriptions contained herein the following notation is used: 
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• A "Community Set" is a set of communities, which may consist of no commu- 
nities (the null community set) or any number of communities. Each 
individual community within the community set is said to be a "member" of 
the set. 

• "Curly brackets { }" indicate a set of communities encompassed by the brack- 
ets, e.g., {a,b,c,...}, indicates the set of communities a, b, c, etc., where the 
names of the member communities are encapsulated in the curly brackets, 
separated by commas. 

• The "intersection" of two sets is the set of members belonging to both sets. An 
"ampersand" indicates an intersection of two communities or sets of 
communities, e.g., x & y, indicates the intersection of two sets x and y, where 
the names of the communities being intersected precede and follow the 
ampersand. 

• A set X is a "superset" of a set Y if and only if all members of Y are also 
members of X. It is said that X "includes" Y when X is a superset of Y. 

• A set X is a "subset" of a set Y if and only if all members of X are also mem- 
bers of Y. It is said that X "is included in" Y when X is a subset of Y. 

Community Route Filtering Approach 1 

In one embodiment, to ensure that community separation policy is enforced for 
MCN 1 10's network communications, a Community Route Filter (CRF) in the protocol 
stack of MCN 1 10 applies rules on each incoming or outgoing packet. The packet's 
source and destination network address are used to determine the user community or set 
of communities to which a packet belongs. The CRF ensures that a packet can never flow 
to networks outside that packet's communities. If an incoming or outgoing packet is 
being routed in compliance with the community separation policy, the packet is allowed 
to pass through the filter. Otherwise, the packet is discarded and the event is recorded in a 
log of security relevant and other events. 
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Community Information Base (CIB) 



The CRF rules use information configured into the MCN 1 10 by a trusted 
administrator, either directly, remotely, or through a management station. In one 
embodiment, this information is called a Community Information Base (CIB) for the 
MCN. In the embodiment shown in Figure 1, two associations are maintained in the CIB: 
(1) for each node in the enterprise network (identified by the node's network address), the 
user community or set of communities which the node serves, and (2) for each network 
interface on the MCN, the user community or set of communities associated with the 
network attached to the network interface. Association 1 may be referred to as the Net- 
work Address Community Set (NACS). Addresses from the Internet Protocol (IP) or 
other network layer or data link layer protocols may be used. Association 2 may be 
referred to as the Interface Community Set (IFCS). The MCN must protect the CIB from 
being modified by untrusted entities. 

Packet Processing 

The CRF rules described below specify the filtering applied to outgoing and incoming 
packets, respectively: 

MCN Send Rule for Outgoing Packets 

1 . Determine the Packet Community Set (PCS) of the packet from the intersec- 
tion of the source NACS and the destination NACS. 

2. If the PCS is null (empty), discard the packet and record the event in a log of 
security relevant and other events. 

3. If the IFCS of the interface on which the packet will be output is not a superset 
of the PCS, discard the packet and record the event in a log of security 
relevant and other events. 
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4. Allow transmit processing to proceed on the packet. 
MCN Receive Rule for Incoming Packets 

1 . Determine the PCS of the packet from the intersection of the source NACS 
and the destination NACS. 

2. If the PCS is null (empty), discard the packet and record the event in a log of 
security relevant and other events. 

3. If the IFCS of the interface on which the packet was received is not a superset 
of the PCS, discard the packet and record the event in a log of security 
relevant and other events. 

4. Allow receive processing to proceed on the packet. 

Figure 2 illustrates an example of a CRF send rule in computer network 100. In 
the example shown, assume that MCN 110 is processing an outgoing packet 2000 that 
was either generated within MCA 100, or received on one of MCN 110's network 
interfaces for forwarding to another network attached to MCN 1 10. Packet 2000 has an 
exemplary source NACS of {A,B,C} (the community set associated with MCN 110 and 
its network addresses), and a destination NACS of {B}. MCN 110 determines the PCS of 
packet 2000 to be {B}, the intersection of its source NACS {A,B,C} and destination 
NACS {B}. Because the PCS = {B} is not null, the data packet is not immediately 
discarded. Next, MCN 110 validates whether the IFCS of ifl, the interface on which the 
packet will be transmitted, includes the PCS of the packet. In this case, the IFCS = {B } 
and the PCS = {B }. Therefore, the data packet 2000 is allowed to be output on ifl. If the 
IFCS did not include the PCS, the packet would be discarded and the event would be 
recorded in a log of security relevant and other events. 

Figure 3 illustrates an example of a CRF receive rule in computer network 100. In 
the example shown, MCN 1 10 is processing an incoming packet 3000 that was received 
on interface ifl. Packet 3000 has a source NACS of {B} and a destination NACS of 
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{ A,B,C). MCN 1 10 determines that the PCS of packet 3000 is {B}, the intersection of 
the source and destination NACS. Because the PCS = {B} which is not null, the data 
packet is not immediately discarded. Next, MCN 110 validates whether the IFCS of if 1, 
the interface on which the packet was received, includes the PCS of the packet. In this 
case, the IFCS = {B} and the PCS = {B}. Therefore, receive processing for the data 
packet 2000 is allowed to proceed. If the IFCS did not include the PCS, the packet would 
be discarded and the event would be recorded in a log of security relevant and other 
events. 

Figure 4a is a flowchart illustrating one embodiment of a CRF. In the figure, it is 
assumed that the CRF is positioned between the data link layer and network layer, though 
alternative embodiments are possible and are contemplated. In figure 4a, the entry point 
"Begin Incoming Packet Filtering" is entered when a packet is received on one of MCN 
1 10' s network interfaces. The destination of the packet may be MCN 1 10, or MCN 1 10 
may be forwarding the packet to another network. For incoming packet filtering, the CRF 
in MCN 1 10 computes the PCS from the intersection of the Source NACS and 
Destination NACS of the incoming packet. The PCS would be null if the source and 
destination nodes have no communities in common. Since attempts to communicate 
between such nodes is a violation of the community separation policy, the CRF discards 
the packet and records the event in a log of security-relevant and other events. If the PCS 
is not null, the CRF then checks whether the PCS is included in the IFCS of the interface 
on which the packet was received (decision block 420). If it is not, this is a violation of 
the community separation policy and the packet is discarded. For example, attacker on a 
node in Community A may be attempting to communicate with a peer on node in 
Community B by using an address in Community B as the source address of the packet, 
thereby masquerading as a Community B node. If the PCS is not included in the IFCS, 
the CRF discards the packet and records the event. If the PCS is not null, the CRF allows 
further packet receive processing to proceed. 
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Figure 4b is a flowchart illustrating one embodiment of a CRF applied to an 
outgoing packet. The outgoing packet may have been generated by MCN 1 10, or may 
have been received on one of MCN's network interfaces to be forwarded by MCN 1 10 
and output on another network interface. For outgoing packet filtering, the CRF in MCN 
1 10 starts with computing the PCS from the intersection of the Source NACS and the 
Destination NACS. A null PCS indicates a violation of the community separation policy 
and the CRF discards the packet and records the event in a log of security relevant and 
other events. For example, an attacker in Community A may attempt to have MCN 1 10 
forward a packet from a Community A network to a Community B network. If the PCS is 
not null, MCN 1 10 determines whether the PCS is included in the IFCS of the network 
interface on which the packet will be output (decision block 440). If it is not, a violation 
of the community separation security policy has been attempted, and the CRF discards the 
packet and records the event in a log of security relevant and other events. Otherwise the 
CRF allows further transmit processing to proceed for the packet. 

It should be noted that the application of community route filtering is "stateless" 
in that packets contain no special information related to previous rule applications and 
carry with them no labels or other history information to support the community route 
filtering, other than the data carried in the standard protocol headers. The stateless 
processing applies to incoming packets from the network destined for the MCN, outgoing 
packets originating within the MCN destined for the network, and packets received from 
the network to be forwarded to another network by the MCN. In the forwarding case, the 
incoming and outgoing CRF processing are independent of each other - no CRF state 
from incoming packet processing need to be retained to be applied in outgoing packet 
processing. Advantageously, packets need not be modified and filtering rules may be 
applied without specific knowledge of the history of the packet (i.e., they are stateless). 
Likewise, the following two approaches are stateless. 

Community Route Filtering Approach 2 
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In an alternative embodiment, to ensure that community separation policy is 
enforced for MCN 1 10' s network communications, a Community Route Filter (CRF) in 
the protocol stack of MCN 110 applies rules on each incoming or outgoing packet. The 
CRF prevents a packet from flowing to networks outside the packet's communities. The 
enforcement has the same effect as those of Approach 1, but the database is organized 
differently and rules may be expressed differently as specified below. 

Community Information Base (CIB) 

A trusted administrator configures two sets of addresses for each interface: (1) the 
Attached Address Set (AAS), which are the addresses on the attached network or 
networks, and (2) the Peer Address Set (PAS), which are the addresses on other networks 
or within the MCN with which the nodes on the attached network or networks may 
communicate. 

Packet Processing 

Using the associations in the CIB, the alternative CRF rules may be applied to the sending 
and receiving of packets: 

Alternative MCN Send Rule for Outgoing Packets 

1 . Validate that the source network address of the packet is within the PAS 
associated with the interface over which the packet will be output. 

2. If it is not, discard the packet and record the event in a log of security relevant 
and other events. 

3. Validate that the destination network address of the packet is within the AAS 
associated with the interface. 

4. If it is not, discard the packet and record the event in a log of security relevant 
and other events. 
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5. Otherwise, if the packet passes both validations, allow transmit processing to 
proceed on the packet. 

Alternative MCN Receive Rule for Incoming Packets 

1 . Validate that the source network address of the packet is within the AAS asso- 
ciated with the interface over which the packet was received. 

2. If it is not, discard the packet and record the event in a log of security relevant 
and other events. 

3. Validate that the destination network address of the packet is within the PAS 
of the interface over which the packet was received. 

4. If it is not, discard the packet and record the event in a log of security relevant 
and other events. 

5. Otherwise, if the packet passes both validations, allow receive processing to 
proceed on the packet. 

Community Route Filtering Approach 3 

In another embodiment, the community separation policy is enforced by ensuring 
that all routing table entries in MCN 1 10 comply with the policy. This, combined with 
restrictions on packet forwarding between interfaces and source address spoofing 
protection on incoming packets, ensures that community separation is enforced on MCN 
110. 

Community Information Base (CIB) 

A trusted administrator configures databases for a MCN community route filtering 
function. For each of the MCN's interfaces, the administrator enters the Interface 
Community Set (IFCS), specifying the community set associated the each interface, and 
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the Attached Address Set (AAS), specifying the destination addresses or destination 
subnets/prefixes that are reachable through the interface. 

Ensuring Route Table Compliance 

In Approach 3, the MCN validates all routing table updates to ensure that table 
entries comply with the community separation policy. The MCN may receive routing 
table updates from a router, other network node, or system administrator. The updates 
specify the next hop to a destination address or destination subnet. When the MCN 
receives a routing table update, functions it performs may include the following: 

1 . Determining the network interface through which the next hop will be reached. In one 
embodiment, the interface may be specified in the routing table update, or may be 
determined by finding the interface whose network address prefix (e.g., for IPv4, the 
network number and subnet number) matches that of the next hop. 

2. Checking whether the destination address is within the AAS of the network interface. 

3. If it is not, discard the routing table update and record the event in a log of security 
relevant and other events. 

4. Otherwise, proceed with the routing table update. 

5. As an alternative to step 2, the MCN may check that the NACS of the destination 
network address or network prefix is within the EFCS of the network interface through 
which packets for the destination will be routed. 

Packet Processing 

Outgoing Packets Originating on the MCN 
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The community separation enforcement relies on route table compliance with the 
community separation policy. If the route table complies, the MCN should never send a 
packet out a network interface (1) through which the destination address is not reachable 
and (2) whose community set does not include the community set associated with the 
destination. 

Incoming Packets from an Attached Network 

For incoming packets, the MCN: 

1 . Checks that the source address is within the AAS of the interface over which the 
packet was received. 

2. If it is not, discards the packet and records the event in a log of security relevant and 
other events. 

3 . Otherwise, allows receive processing to proceed. 

Step 1 may be implemented as a simple address look up of the source address in the AAS. 
Alternatively, the routing table can be used, assuming incoming and outgoing routes are 
symmetrical. In this alternative, if the MCN were to send a packet back to the node with 
this source address, it would send it out the interface on which this packet was received. 

Packets Forwarded from One Network Interface to Another 

For packet received on one interface to be forwarded to another, the MCN: 

1 . Computes the intersection of the incoming interface BPCS and the outgoing interface' s 
DFCS. 

2. If the intersection is not null, allows packet procession to proceed. 
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3. Otherwise, discards the packet and records the event in a log of security relevant and 
other events. 

Community Route Filtering Scenarios 

Figure 5 shows one embodiment of Community Information Base (CIB) 160 in an 
MCN 510 using Community Route Filtering approach 1. In the exemplary embodiment 
shown, two associations are maintained in the CIB: (1) The Network Interface-Com- 
munity Association (NICA) 530, that specifies, for each of MCN 510's network 
interfaces, the associated user community or community set, and (2) the Network 
Address-Community Association (NACA) 540, that specifies, for each network address 
used by MCN 510, the associated user community or community set. Excerpts from CIB 
160 will be used in the discussions of Figures 6 and 7. 

The first row in NICA 530 shows ifO of MCN 510 attached to a network used to 
communicate information for communities A, D, G, M, and Q by nodes serving those 
communities. The second row shows ifl of MCN 510 attached to a network used to com- 
municate information for communities D and Q by nodes serving those communities. The 
third through fifth rows show if2, if3, and if4 of MCN 510 attached to networks used by 
nodes in communities A, G, and M, respectively. 

NACA 540 shows the community or community set associated with each network 
address, list of network addresses, or range of network addresses. An asterisk is a wild- 
card, a notational convention indicating that any valid value can be used in the field of the 
address where the asterisk is. For illustrative purposes, Internet Protocol (IP) version 4 
addresses are shown. Other embodiments could use IP version 6, or any other network 
layer or data link layer protocol. The first row of NACA 540 shows network addresses 
195.10.1.1, 195.10.2.1, 195.10.3.1, 195.10.4.1, etc. are associated with the set of commu- 
nities {A,D,G,M,Q}. These addresses are assigned to the local network interfaces on 
MCN 510. The second row shows a range of addresses 195.10.1.2 - 195.10.1.254 used 
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for MCNs serving the set of communities { A,D,G,M,Q}. The third row shows a range of 
addresses 195.10.2.2 - 195.10.1.14 used for MCNs serving the set of communities 
{D,Q,X}. The fourth, fifth, and sixth rows show the range of addresses used by nodes in 
communities A, G, and M, respectively. 

Turning now to Figure 6, a scenario is presented in which MCN 510 has received 
a packet on one of its network interfaces if 1 from an MCN 520, a node at address 
195.10.2.5. MCN 510 serves communities A, D, G, M, and Q, while MCN 520 serves 
communities D, Q, and X. They have communities D and Q in common, and 
communicate information for their common communities over a network for 
communities D and Q. The IFCS on MCN 510 of the interface attached to the network 
over which the packet was received matches the community set of the network, i.e. 
{D,Q}. In the example shown, the NACS for each network address on MCN 510 is the 
same as the community set of the MCN. 

In Figure 6, MCN 510 queries the CIB's 160 NACA 540 for the community sets 
associated with the source and destination network addresses, illustrated as 601 and 602 
in Figure 6. It computes the PCS 604 from the intersection of the Source NACS 601 of 
MCN 520 {D,Q,X}, and the Destination NACS 602 of MCN 510 {A,D,G,M,Q}. The 
computed PCS 604 is {D,Q}. Since the PCS 604 is not null, no security violation of the 
community separation security policy has been attempted. Then, using information from 
the CIB's NICA 530, MCN 510 validates that the PCS is within the IFCS 603 for ifl on 
MCN 510, the network interface over which the packet was received. Since the IFCS is 
{D,Q} and the PCS is {D,Q}, there is no security violation, and MCN 510 proceeds with 
the receive processing for the packet. 

Figure 7 illustrates a scenario in which MCN 510 is sending a packet to an MCN 
520. MCN 510's CIB 160 is as illustrated in Figure 5. MCN 510 computes the PCS 704 
from the intersection of the Source NACS 701 for MCN 510 { A,D,G,M,Q} and the 
Destination NACS 702 for MCN 520 {D,Q,X}. The PCS is {D,Q}. Since the PCS is not 
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null, no security violation of the community separation security policy has been 
attempted. MCN 510 then determines whether the PCS is within the EFCS 703 for if 1, the 
network interface over which the packet will be transmitted. Since it is (i.e., they are both 
{D,Q}), MCN 510 proceeds with the transmit processing for the packet. 

Community Route Filtering in Virtual Private Networks 

A virtual private network (VPN) is a well known method whereby encryption and 
tunneling are used to create a private network while using a shared or public 
infrastructure, such as the Internet. For example, a particular enterprise may wish to 
provide a connection between its computer networks at sites which are located in 
different parts of the world. By using VPN technology, the enterprise may utilize the 
Internet for the communications while ensuring privacy and integrity. Alternatively, an 
enterprise may wish to share its network resources internally among users in multiple 
communities. Rather than use a physically separate network or virtual local area network 
for each community network, an enterprise may employ VPNs to carry traffic for each 
community over a shared network fabric. With VPNs, cryptographic methods are used to 
separate the traffic for each community over the same network resources, preventing 
users in one community from reading or modifying messages sent by users in a different 
community. VPNs are often (but not necessarily) implemented in the network layer, for 
example, in IP version 6 or the IP security extensions to IP version 4 (referred to as 
IPSec). 

Figure 8 is an illustration of a computer network 800 including three VPNs num- 
bered VPN 1 870, VPN 2 874, and VPN 3 872. MCN 810 serves communities A, B, and 
C. Node 840 is a community A computer. It communicates with MCN 810 over VPN 1 
870. Communications over VPN 1 870 travel encrypted over Encrypted Network 830. 
The encryption for VPN 1 870 is configured so that packets cannot be read or modified 
by entities outside of community A. The VPN encryption further allows authentication of 
the endpoints to each other, so that, at a minimum, they each can determine that the other 
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is in community A. Communications between Community B Node 844 and MCN 810 are 
over VPN 2 874. Encrypted packets are carried over Encrypted Network 830. 
Communications between MCN 842, serving communities A, B, and C, and MCN 810, 
serving the same communities, are over VPN 3 872. Packets are encrypted and carried 
over Encrypted Network 830. 

On MCN 810, the VPN interfaces all share a single physical interface, ifO 860. A 
CIB 890 maintains an association between the VPNs and their communities or sets of 
communities (the VPN Community Set [VPNCS]). VPN 1 870 is associated with Com- 
munity A, VPN 2 874 is associated with Community B, and VPN 3 872 is associated with 
the set of communities { A,B,C}. When MCN 810 sends packets out via network interface 
ifO 860 to Nodes 840, 842, and 844, it encrypts the packets. Incoming packets received on 
ifO are decrypted, using cryptographic parameters associated with the VPN over which 
the message was communicated and using header information carried in the packet. 

Any of the three Community Route Filtering approaches described above may be 
used with VPN, wherein the VPN may be treated as a subnet with network interfaces at 
each node communicating over the VPN. In one embodiment, the above described 
Community Route Filtering Approach 1 may be applied to VPNs. The VPNCS for each 
VPN is entered in MCN 810's CIB. Each network interface on MCB 810 may be 
assigned one of three encryption modes: Always Encrypt, Selective Bypass, or Never 
Encrypt. All data packets output over interfaces which have attribute Always Encrypt are 
encrypted, using cryptographic parameters and key for the appropriate VPN between the 
source and destination. All packets received from such a network are decrypted, using the 
cryptographic parameters for the VPN. For Selective Bypass interfaces, all data packets 
sent on the interface are encrypted using the appropriate VPN for the source and 
destination, except packets whose community sets are included in the Plaintext 
Community Set (PTCS) of the attached network. Received packets are decrypted if their 
headers indicate that they were encrypted. Selective Bypass may be used when nodes in 



23 



the enterprise network share one or more common communities, but not all communities. 
For interfaces with the Never Encrypt attribute, encryption is not used. 

The topology rule previously presented for the community route filtering also 
applies to VPNs. A node may access (read or write) a VPN only if the community set of 
the node includes the community set of the VPN. The community set of a VPN is the set 
of communities for which information may be communicated over the VPN. Therefore, 
when the Always Encrypt attribute is set for all nodes sharing a network, then VPNs con- 
nect nodes which have common communities. When the Selective Bypass attribute is set 
for nodes sharing a network, a PTCS is associated with the network. Nodes with the 
Selective Bypass attribute configured on a network interface may be connected to a 
network over that interface only if the community set of the node includes the PTCS of 
the network, and nodes may access a VPN only if the node's community set includes the 
VPNCS. VPNs may be dynamically established or statically set up. The trusted network 
administrator configures VPNs to allow or prohibit nodes from accessing them using a 
variety of methods including cryptographic key distribution and access control. 

Figure 9a is a flowchart illustrating the application of Community Route Filtering 
rules in the context of VPNs. The flowchart in figure 9 is identical to the flowchart in fig- 
ure 4, with the exception of checking whether the PCS is within the VPNCS in 920 and 
940 rather than within the IFCS in 420 and 440. 

Figure 9a is a flowchart illustrating one embodiment of a CRF. In figure 9a, the 
entry point "Begin Incoming Packet Filtering" is entered when a packet is received on one 
of MCN 810's network interfaces. The destination of the packet may be MCN 810, or 
MCN 810 may be forwarding the packet to another network. For incoming packet 
filtering, the CRF in MCN 810 computes the PCS from the intersection of the Source 
NACS and Destination NACS of the incoming packet. The PCS would be null if the 
source and destination nodes have no communities in common. Since attempts to 
communicate between such nodes is a violation of the community separation policy, the 
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CRF discards the packet and records the event in a log of security-relevant and other 
events. If the PCS is not null, the CRF then checks whether the PCS is included in the 
receive VPNCS of the interface on which the packet was received (decision block 920). If 
it is not, this is a violation of the community separation policy and the packet is 
discarded. If the PCS is not included in the receive VPNCS, the CRF discards the packet 
and records the event. Otherwise, the CRF allows further packet receive processing to 
proceed. 

Figure 9b is a flowchart illustrating one embodiment of a CRF applied to an 
outgoing packet in a VPN. The outgoing packet may have been generated by MCN 810, 
or may have been received on one of MCN's 810 network interfaces to be forwarded by 
MCN 810 and output on another network interface. For outgoing packet filtering, the 
CRF in MCN 810 computes the PCS from the intersection of the Source NACS and the 
Destination NACS. A null PCS indicates a violation of the community separation policy 
and the CRF discards the packet and records the event in a log of security relevant and 
other events. If the PCS is not null, MCN 810 determines whether the PCS is included in 
the transmit VPNCS of the network interface on which the packet will be output 
(decision block 940). If it is not, a violation of the community separation security policy 
has been attempted, and the CRF discards the packet and records the event in a log of 
security relevant and other events. Otherwise the CRF allows further transmit processing 
to proceed for the packet. 

It is noted that the examples and figures described above are intended to be 
exemplary. Numerous variations and modifications will become apparent to those skilled 
in the art once the above disclosure is fully appreciated. Further, the above described 
methods and mechanisms may be used independently or in one of many combinations 
with each other where desired. It is intended that the following claims be interpreted to 
embrace all such variations and modifications. 
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